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Abstract. The Robin Hood game is played as follows: On day i, 
the Sheriff puts s{i) bags of gold in the cave. On night i, Robin 
removes r{i) bags from the cave. The game is played for each i € N. 
Robin wins if each bag which was put in the cave is eventually 
removed from it; otherwise the Sheriff wins. 

Gasarch, Golub, and Srinivasan studied the Robin Hood game in 
the case of random strategies where Robin has no historical mem- 
ory. We extend their main result to the case of bounded historical 
memory, and obtain a hierarchy of provably distinct games. 



1. The Robin Hood game 

The Robin Hood game RH{r, s, A) is defined for functions r,s : N —>■ 
N sucfi that 1 < r{i) < s{i) for each i, and for a set A, as follows: 

(1) On day i, the Sheriff (of Nottingham) puts s{i) bags of gold 
in the cave, each labelled by an element of A. No label is used 
twice (over the course of the entire game). 

(2) On night i, Robin (Hood) removes r{i) bags from the cave. 

The game is played for each i G N. Robin wins if each bag which was 
put in the cave is eventually removed from it; otherwise the Sheriff 
wins. 

It is easy to see that if Robin has an unlimited historical memory 
(knowing at each night i which of the bags in the cave appeared first), 
then he has a winning strategy: On night i pick r{i) bags out of those 
which arrived first. 

Deterministic strategies for this game were studied, from the set- 
theoretic point of view, in [2, 3]. Gasarch, Golub and Srinivasan [1] 
consider the case where Robin has no historical memory, that is, he 
cannot distinguish between the days where the bags were put in the 
cave. They suggest the following probabilistic strategy for Robin: On 
night i, remove random r{i) bags out of the cave (with uniform distri- 
bution). They say that Robin wins almost surely if for each bag put in 



Supported by the Koshland Center for Basic Research. 



2 



BOAZ TSABAN 



the cave, its probability of being eventually removed is 1. The proba- 
bility is taken over Robin's coin tosses. More precisely, the probability 
that a bag is not removed is the product of all probabilities Pi that the 
bag is not removed at night i, and the Sheriff's winning (or Robin's 
loosing) probability is the supremum of all probabilities that a bag x 
put in the cave is never removed. ""^ Let L(i) — s{j) — r{j) denote 
the number of bags in the cave after night i. The main result in [1] is 
that Robin wins almost surely if, and only if, the series 



diverges; otherwise Robin loses almost surely. 

2. Strategies with bounded historical memory 

We generalize the above mentioned result to the case of bounded 
historical memory. The typical case is that Robin can, on each night, 
identify the bags put in the cave on the last k days, where k is constant. 
It will turn out that already the natural strategy for historical memory 
A; = 1 is strictly stronger than the natural strategy in the mcmorylcss 
case. Moreover k = 2 yields a strictly stronger strategy than k = 1, etc. 
(Theorem 3.1). In fact, the game can be analyzed in a much broader 
family of cases, as will be shown in the sequel. 

The most general case is that Robin can, on night i, identify the 
bags put in the cave on the last b{i) days, where 6 : N — N U {0} is a 
function with b{i) < i for all i.^ (So that b{i) = is the memoryless case 
studied in [1]). It is natural to denote this game by RH{r, s, b, A), but 
our analysis below is independent of the set so we will simply write 
RH{r, s, b). A key observation is that the following natural restriction 
leads to a substantial simplification of the analysis of the generalized 
games. 

Restriction 2.1. We pose the restriction that Robin cannot remember 
anything that he forgot earlier, that is, b{i + 1) < b{i) + 1 for each i; 
equivalently, the function i — b{i) is nondecreasing. 

We suggest the following deterministic and random strategies for 
Robin, motivated by the strategy given in [1] for the memoryless case: 
Call a bag very old if Robin cannot tell the day it was put in the cave. 

-"^Our definition of the Sheriff's winning probability is simpler than the one given 
in [1], but both our and the proofs of [1] work for both definitions and actually 
imply that the definitions are equivalent. 

^6(i) stands for the bound on Robin's historical memory on night i. 
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An important observation is that Robin can identify the very old bags 
since he can identify the bags which are not very old. 

OldestoEr: On night i Robin chooses any r{i) many bags out of the very 



old bags. If there are less than r{i) many very old bags, then 
Robin also chooses some of the oldest bags among the ones he 
remembers, so as to choose r{i) bags in total. 



Oldestijjvo: Same as 0\deslDET-, but the r{i) bags are chosen at random, 
with uniform probability, out of the older bags.^ 
Observe that if Oldest ^jbt is a winning strategy for Robin, then so is 
Oldest ijivi?. 



Then L{i) is the number of bags put in the cave on days 1,2,... ,i — b{i) 
and not removed until day i. 

Proposition 2.2. 

(1) If i — h{i) is bounded, then Oldesto^^ is a winning strategy for 
Robin in RH{r, s, b) (for each r, and s). 

(2) // there exist infinitely many i such that L{i) < r{i), then 
OldestijET is a winning strategy in RH{r, s,b). 

Proof. (1) is easy. To prove (2), assume that a bag was put in the cave 
on day d. By (1) we may assume that i — b{i) is unbounded. Let i 
be such that d < i — b{i). Restriction 2.1 ensures that this will also 
hold for all larger i's, so we may assume further that Z(i) < r(i). This 
means that on night i, all bags put on days < i — b{i) (in particular, 
those put on day d) were removed from the cave. □ 

We may therefore make the following additional restriction. 

Restriction 2.3. L{i) > r{i) for all but finitely many i. 

^To put this more precisely, on night i Robin has a partition of the bags in the 
cave into disjoint (possibly empty) sets Sq, Si. . . . , S^^i) such that 5*0 is the; set of 
very old bags, and for k = 1, . . . , r{i), Sh is the set of bags put in the cave r{i) — k 
days ago. If 1 5*01 > r{i), then Robin chooses any r{i) many bags out of the bags 
in 5*0- Otherwise, let m be the minimal such that r{i) < J2T=o \ ^k\- Then Robin 
takes all bags in the sets Sq, . . . , Sm-i, as well as r{i) — J2T=o l*^*! ^^any bags from 



Using the notation of the previous footnote. If |5o| > r{i), then Robin chooses at 
random (with uniform probablity) r{i) many bags out of the bags in Sq. Otherwise 
Robin takes all bags in the sets 5*0, . . . ,Sm-i, as well as r{i) — ^2^=0 I'^'^l ™any 
random bags from Sm- 
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Theorem 2.4. Assume that r, s, and b satisfy Restrictions 2.1 and 
2.3, and Robin uses the strategy Oldest /jjvd. 

(1) If^r{i)/L{i) — oo, then Robin wins almost surely. 

(2) If^'r{i)/L{i) < oo, then the Sheriff wins almost surely. 

Proof. If there is i such that L(i) < r{i), let i* be the maximal such i. 
Then on night i*, all bags put in the first i* — b{i*) days are removed, 
and L{i) > r{i) for all i > i*. Since the convergence of the series in 
question does not depend on the first few elements, this shows that we 
may assume that L{i) > r{i) for all i. 

Observe that if i — b{i) is bounded, then L{i) is eventually equal to 
0, contradicting our assumption, thus i — b{i) is unbounded. Assume 
that a bag was put in the cave on day d, then for each large enough i, 
d < i — b{i) so that on night i, the probability that the bag in question 
is removed is r{i)/ L{i). 

Now, the probability that a bag put in the cave on day d is not 
eventually removed is 

The product (1) converges to (i.e., Robin wins almost surely) if 
Y^r{i) / L{i) ~ oo. If ^r(i)/I/(i) < oo, then the product (1) is positive 
for d = 1. Thus, its limit when o? — > oo is 1. Consequently, the Sheriff 
wins almost surely. □ 

Note that in Theorem 2.4, (1) implies that the other direction of (2) 
also holds, and (2) implies that the other direction of (1) also holds. 
Thus, the theorem gives an exact characterization of when Robin wins 
almost surely and when the Sheriff wins almost surely, and shows that 
it is always the case that one of them wins almost surely. In the case 
b{i) = 0, Theorem 2.4 reduces to the main result of [1], described at 
the end of Section 1. 

3. Historical memory helps 

To make sure that the generalization made in 2.4 is not trivial, we 

must find instances where additional historical memory changes the 
strategy's status from a loosing strategy to a winning one. 

Assume that 6, c : N — > N. We say that c eventually dominates b if 
there exists m such that for all i > m, b{i) < c{i). 

Theorem 3.1. Assume that c eventually dominates b, i — c{i) is un- 
bounded, and b and c satisfy Restrictions 2.1 and 2.3. Then there exist 
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functions r, s : N — >• N such that for Robin, Oldest /jiVD is a (surely) 
winning strategy in RH{r, s, c) and an almost-surely loosing strategy in 
RH{r,s,b). 

Proof. Since convergence of series does not depend on the first few 
terms, wc may assume that for each i, h{i) < c(i). Since L{i) also 
depends on the bounding function b, let us denote it here by Lf,{i). It 
follows that for each r and s, Lc{i) < Lb{i) for all i. It thus suffices 
to consider the case where c{i) = b{i) + 1 for each i, and therefore 
Le(i) + s(i-6(i)) = h{i). 

At step i of the construction we have the definition of s at 1, . . . , i — 
c{i) and r at 1, ... ,i — 1, and therefore Lc{i) is defined. Define r{i) = 
max{i, Lc{i)}, and define s oni — c{i) + 1, . . . , i + 1 — c(i + 1) to be r(i)^ 
(so that r{i)/Lb{i) = r{i)/{Lc{i) + s{i - h{i))) = r{i)/{r{i) + r{if ) < 
l/riif < 1/i^). 

Since r{i) > Lc{i) for each i, we have by Proposition 2.2 that 
OldestfiAT/j is a winning strategy in RH{r, s,c). Now, ^^{i) / L}j{i) < 
^ < oo, so by Theorem 2.4, OldestijiVD is an almost-surely loosing 
strategy in RH{r, s,b). □ 

In particular, we have the following. 

Corollary 3.2. For each n = 0,1,2,..., there exist functions r,s : 
N — > N such that for Robin, Oldest /j^vd is a (surely) winning strategy 
in RH{r, s,n + l) and an almost-surely loosing strategy in RH{r, s, n). 

4. Random Sheriff 

The authors of [1] pose the question of the behavior of the Robin 
Hood game when the Sheriff's strategy is random as well. Our analysis 
in Section 2, being independent of the Sheriff's moves, shows that the 
results apply to this case as well. In addition to the first strategy 
of [1] which was described in the introduction to the present paper 
(Section 1), a second random strategy for Robin is sketched in [1], and 
is conjectured to be an almost-surely winning strategy in the game 
RH{l,s, [0, 1]) where s is constant. 

While we are unable to analyze the second strategy for lack of some 
details, we can see that the first strategy already works. Here b{i) — 
(no historical memory) and L{i) — Yl]=i ^U) ~ '"0) — 5^j=i s — 1 — 
i(s — 1), therefore 
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thus by Theorem 2.4, Oldestj^Aro is an almost-surely winning strategy 
in this game. Since Oldest j^jvj:) coincides with the first strategy of [1], 
wc have that the first strategy of [1] is also an almost-surely winning 
strategy against a random Sheriff in RH {1, s, [0,1]) (as well as any 
game RH{r, s, A) with + r{i)) diverging). Theorem 2.4 

is an extension of this phenomenon to the case of nonzero historical 
memory. 

5. Open problems 

Among the problems which naturally arise, the following two seem 
to be the most interesting. 

Conjecture 5.1. OldestijjvD is the best random strategy among the 
strategies which are independent of the index set A. 

Our analysis repeatedly uses Restriction 2.1 posed on the bounding 
function b. 

Problem 5.2. Analyze the the case where b does not satisfy Restriction 
2.1. 

Finally, our strategy Oldestj^jVD uses unboundedly many "random 
bits". The referee suggests the problem whether good strategies ex- 
ist, in which the number of random bits used at each specific step is 
bounded by some constant. 
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